From Neel to NPC: Colouring Small Worlds 
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In this note, we present results for the colouring problem on small world graphs created 
by rewiring square, triangular, and two kinds of cubic (with coordination numbers 5 and 
6) lattices. As the rewiring parameter p tends to 1, we find the expected crossover to the 
behaviour of random graphs with corresponding connectivity. However, for the cubic lattices 
there is a region near p = for which the graphs are colourable. This could in principle 
be used as an additional heuristic for solving real world colouring or scheduling problems. 
Small worlds with connectivity 5 and p ~ 0.1 provide an interesting ensemble of graphs 
whose colourabllity is hard to determine. For square lattices, we get good data collapse 
plotting the fraction of colourable graphs against the reseated parameter parameter pN^" 
with u = 1.35. No such collapse can be obtained for the data from lattices with coordination 
number 5 or 6. 



u 
u 

o 



> 

o 
o 






X 



Several NP-complete [|T) constraint satisfaction 
problems have recently been found to show 
threshold phenomena. As some parameter is var- 
ied, the fraction of problems than can be solved 
suddenly changes from 1 to (e.g., |^, ^]). A re- 
lated transition occurs for the difficulty of deter- 
mining whether a problem Instance is solvable. 
Far from the transition, this is almost always easy, 
while computationally hard problems are clustered 
near the critical value of the parameter. These 
transitions have been compared to phase transi- 
tion appearing in physical systems, and has at- 
tracted much interest from physicists who have 
used techniques from statistical physics such as 
finite-size scaling H and replica symmetry break- 
ing [^ to study it. Most of the work by physicists 
has so far been concentrated on the boolean sat- 
isfiability problem, though it should be noted that 
there has been much analytical work on the num- 
ber partitioning problem ||^] . 

One important NP-complete problem is the k- 
colourlng problem (k-col). It consists of colour- 
ing all the nodes of a graph using k colours in 
such a way that no edge Joins two nodes of the 
same colour. This problem is particularly interest- 
ing for physicists, since it corresponds to finding 
the zero temperature ground state of an antifer- 
romagnetic k-state Potts model. Graph colouring 
also has many real -world applications, including 
scheduling and register -allocation problems. For 
the k-col problem on random graphs with average 
degree 7, Achlioptas and Friedgut have shown 
rigorously that there is a 7c where the fraction of 
colourable graphs jumps from 1 to 0. Even though 
there is currently no exact analytical result for the 
value of 7c, Achlioptas ||8| has bound it rigorously 
by 3.84 < 7c < 5.05. 

Small world graphs have recently been intro- 



duced in an attempt to capture the topological 
properties of real graphs. Regular lattices have 
long average distance between nodes, but show a 
high degree of clustering (i.e., if we remove a node 
from the graph, its neighbours will still have short 
paths between them). On the other hand, random 
graphs ||9| have no clustering and small average 
distances. Watts and Strogatz 1 10, 1 1 1 have there- 
fore proposed a new graph model. In their model, 
we start from a regular graph and apply a rewiring 
process to each edge in it: with probability p, the 
edge is replaced by a short-cut, linking one of the 
original nodes to a randomly selected other node in 
the graph. The total number of edges (and hence 
the mean connectivity) is thus conserved in the 
small world model. In Watts and Strogatz's original 
model, a ring lattice where each node is connected 
to its 2fc nearest neighbours is used as a starting 
point; most of the work done on small worlds use 
this model too. For recent reviews on this and re- 
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lated graph models, see [ |12| , 

Here we use other lattices as starting points. The 
motivation for this is to determine the infiuence 
of the small world properties of the graphs on the 
phase transition. Since 7 = 4 for the 2D square lat- 
tice and 7 = 6 for the 2D triangular and 3D simple 
cubic lattices, we know that for p = 1 they should 
display completely different behaviour (at least in 
the thermodynamic limit of A^ ^ cx)). For p = 0, all 
lattices used in this paper are colourable using 3 
colours. (In physics the repeating pattern of alter- 
nating colours used for this is called a Neel state.) 

The hardness of colouring small-world graphs 
has previously been investigated by Walsh [14|, 
who used the original linear model of Waltz and 
Strogatz. In addition to studying some other 
constraint satisfaction problems on small world 
graphs, Walsh showed that the cost to prove that a 



small world graph Is colourable has an "easy-hard- 
easy" behaviour as a function of p. The results pre- 
sented here are different, since the rewiring pro- 
cedure starts from other lattices. In particular, 



since it is known [15| that k-col on random graphs 
displays a "phase-transition" as the connectivity 7 
passes a threshold value 7c « 4.6, it is worthwhile 
to investigate whether there are differences when 
starting from lattices with connectivity 4, 5, and 6. 

Another motivation for using other lattices as 
starting points is an interpretation of k-col as a toy 
model of a complex system that displays frustra- 
tion. Such models need to be placed on more real- 
istic graphs. For example, networks that model the 
interactions between agents occupying different 
parts of a land area and competing for some com- 
mon resource are best modeled using the square 
lattice as a starting point. 

To colour the graphs, a backtrack search pro- 
gram based on the Brelaz heuristic [16| was used. 
Simulations were performed for the 2D square 
(connectivity 7 = 4) and triangular (7 = 6) lattices 
as well as two different 3D simple cubic lattices, 
with 7 = 5 and 6. The cubic lattice with 7 = 5 was 
obtained from the simple cubic lattice by deleting 
every second vertical edge in a chess-board pat- 
tern. 

The linear size of the square lattice was varied 
from 4 to 7, while the experiments on the cubic 
lattices used L = 3, 4, and 5. Triangular lat- 
tices of linear size 6 and 9 were also tested. For 
each p and lattice, an average was performed over 
up to 10^ different graphs. A considerable smaller 
number of graphs were used for the large L and 
all the 7 = 5 runs. This was necessary because 
of the "easy-hard-easy"-transition and because of 
the exponential time-complexity of the Brelaz algo- 
rithm. The number of nodes visited in the search 
tree was used as a measure of the cost of colour- 
ing a graph or determining that no solution exists. 
The random number generator used to generate 
most of the graphs is the Mitchell-Moore generator 
(see, e.g., |17]). Similar results were obtained in 



test runs using the standard C library's drand4 8 ( ) 
generator. 

Figure |l] shows the results for the fraction of 
colourable graphs for all different start lattices. 
Notice that this and the other plots are in a 
semilogarithmic scale. Plot legends describe the 
lattice and its linear size. The symbol "F" denotes 
the 7 = 5 cubic lattice; thus "F 4" denotes a system 
of size A^ = 4^ = 64 variables. 

In figure ^ we compare the data for the square 
and 7 = 5 cubic lattices, while figure |3| shows the 
7 = 5 and 7 = 6 data from the runs on the trian- 
gular and cubic lattices. The phase transition in 
solvability can be seen quite clearly in these fig- 
ures. But note that even for rather large p and N , 
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FIG. 1: This semilogarithmic plot shows the fraction of 
colourable graphs as a function of p for various starting 
lattices. In the legend, "2D", "F", "3D", and "Tri" denote 
the square, 7 = 5 cubic, normal cubic, and triangular 
starting lattices. The numbers In the legend are the lin- 
ear size of the lattice. Data were obtained by averaging 
over from 1000 (for some of the "F" data) to 10^ differ- 
ent graphs. The differences between the data for graphs 
with 7 = 4, 5, and 6 Is clearly seen. See also figures y 
and H for detailed comparisons of the different 7's. 
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FIG. 2: This shows the difference between the square 
lattice (top curves) and -r = 5 cubic (bottom curves) data. 
(Same data as In figure [l| 



there is still a rather high probability that a 7 = 5 
graph can be coloured. In fact, the appearance of 
the i = 3, 4, and 5 curves seems to indicate that 
there could be a cross-over at a finite p. Unfor- 
tunately, the exponential time requirements of the 
Brelaz algorithm currently prevents us from inves- 
tigating this in more detail numerically. 

As seen in figure ^, good data collapse can be ob- 
tained for the square lattices by plotting the solv- 
able fraction as a function oi pN^" with v = 1.35. 
No such collapse can however be obtained for the 
cubic or triangular data. 

In figures ^ and ^, we show the cost (measured 
as the number of nodes visited in the search-tree) 
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FIG. 3: This shows the difference between the 7 = 5 
cubic (top curves) and 7 = 6 cubic and triangular lattice 
(bottom curves) data. (Same data as in figure m 



2D square. k=3 colouring. 10 graphs, U 4,5,6,7. 



colourable even for 7 = 5 and 6. We found a 
new class of problems that are hard for the Bre- 
laz algorithm and could be used as a benchmark 
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FIG. 5: The average cost of determining whether a graph 
can be coloured or not Is also Interesting. Here we com- 
pare the cost for 7 = 4 and 7 = 5 as functions of p. 
Note that the cost depends more on the number of vari- 
ables in the problem than on the coordination number 
of the graphs. Large system sizes are necessary to see 
the "easy-hard-easy" transition. 



FIG. 4: For the data from square (7 = 4) lattices, a 
good collapse can be obtained by plotting the fraction 
of colourable graphs as a function of p^'^ with u — 3.5. 



for the runs performed. The 7 = 5 graphs prove 
to be much harder than the others. This is nat- 
ural since they are closer to the phase transition 
for random graphs. For the other data, the cost 
is essentially determined by the number of vari- 
ables in the problem, independent of which lattice 
was used as a starting point. The "easy-hard-easy" 
pattern which can be seen for some of the data in 
these figures as a function of p is similar to that of 
k-col on random graphs. 

In conclusion, we studied graph colouring on 
small world graphs produced by starting with reg- 
ular lattices of coordination number 4, 5, and 6. 
The hardness patterns found are similar to those 
for the original small world model. More interest- 
ingly, we found that for finite system sizes, there 
is a range of p's for which the graphs are still 
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FIG. 6: As in figure H, here we compare the costs for 
7 = 5 and 7 = 6 as functions of p. The odd behaviour of 
the data for triangular lattices Is due to finite size effects. 



for new algorithms. Investigating constraint satis- 
faction problems on small world graphs and other 
random graph ensembles with topologies different 
from that of the standard model Q{N, ^jN) is im- 
portant because these graphs might better capture 
the appearance of real world instances of the prob- 
lems. For the same reason, it would be interesting 
to look at other constraint satisfaction problems 
(such as the vertex-cover problem) on such graphs. 
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